SatisfactionData

Dataset statistics

Number of variables	10
Number of observations	226537
Missing cells	455568
Missing cells (%)	20.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	17.3 MiB
Average record size in memory	80.0 B

Variable types

Numeric	10

Alerts

`wime_komfort` is highly correlated with `df_index` and 8 other fields	High correlation
`wime_sauberkeit` is highly correlated with `wime_personal` and 6 other fields	High correlation
`wime_platzangebot` is highly correlated with `wime_personal` and 6 other fields	High correlation
`wime_gesamtzuf` is highly correlated with `wime_personal` and 7 other fields	High correlation
`wime_preis_leistung` is highly correlated with `df_index` and 6 other fields	High correlation
`wime_personal` is highly correlated with `wime_komfort` and 7 other fields	High correlation
`wime_puenktlich` is highly correlated with `wime_personal` and 4 other fields	High correlation
`wime_fahrplan` is highly correlated with `wime_personal` and 6 other fields	High correlation
`df_index` is highly correlated with `wime_komfort` and 1 other fields	High correlation
`wime_oes_fahrt` is highly correlated with `wime_personal` and 3 other fields	High correlation
`wime_personal` has 149074 (65.8%) missing values	Missing
`wime_komfort` has 50395 (22.2%) missing values	Missing
`wime_sauberkeit` has 47232 (20.8%) missing values	Missing
`wime_puenktlich` has 46621 (20.6%) missing values	Missing
`wime_platzangebot` has 45836 (20.2%) missing values	Missing
`wime_gesamtzuf` has 38474 (17.0%) missing values	Missing
`wime_preis_leistung` has 15301 (6.8%) missing values	Missing
`wime_fahrplan` has 8190 (3.6%) missing values	Missing
`wime_oes_fahrt` has 54445 (24.0%) missing values	Missing
`df_index` has unique values	Unique
`wime_komfort` has 2918 (1.3%) zeros	Zeros
`wime_puenktlich` has 4598 (2.0%) zeros	Zeros
`wime_platzangebot` has 6262 (2.8%) zeros	Zeros
`wime_preis_leistung` has 6364 (2.8%) zeros	Zeros
`wime_fahrplan` has 5237 (2.3%) zeros	Zeros

Reproduction

Analysis started	2022-11-22 17:30:56.545845
Analysis finished	2022-11-22 17:31:22.646434
Duration	26.1 seconds
Software version	pandas-profiling v3.4.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	226537
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	113441.2574

Minimum	0
Maximum	229488
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	11499.8
Q1	56807
median	113441
Q3	170075
95-th percentile	215382.2
Maximum	229488
Range	229488
Interquartile range (IQR)	113268

Descriptive statistics

Standard deviation	65397.92223
Coefficient of variation (CV)	0.576491514
Kurtosis	-1.199839849
Mean	113441.2574
Median Absolute Deviation (MAD)	56634
Skewness	2.43676751 × 10^-5
Sum	2.569864213 × 10¹⁰
Variance	4276888232
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
226335	1	< 0.1%
75813	1	< 0.1%
75844	1	< 0.1%
75846	1	< 0.1%
75827	1	< 0.1%
75826	1	< 0.1%
75825	1	< 0.1%
75824	1	< 0.1%
75808	1	< 0.1%
75809	1	< 0.1%
Other values (226527)	226527	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
229488	1	< 0.1%
229345	1	< 0.1%
229287	1	< 0.1%
228803	1	< 0.1%
228738	1	< 0.1%
228717	1	< 0.1%
228687	1	< 0.1%
228498	1	< 0.1%
228420	1	< 0.1%
228400	1	< 0.1%

wime_personal
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	13
Distinct (%)	< 0.1%
Missing	149074
Missing (%)	65.8%
Infinite	0
Infinite (%)	0.0%
Mean	89.87376769

Minimum	0
Maximum	100
Zeros	688
Zeros (%)	0.3%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	50
Q1	77.77777778
median	100
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	22.22222222

Descriptive statistics

Standard deviation	17.83286506
Coefficient of variation (CV)	0.198421247
Kurtosis	6.721953352
Mean	89.87376769
Median Absolute Deviation (MAD)	0
Skewness	-2.361162011
Sum	6961891.667
Variance	318.0110763
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	50819	22.4%
75	9400	4.1%
88.88888889	5367	2.4%
77.77777778	4839	2.1%
66.66666667	1877	0.8%
50	1711	0.8%
44.44444444	885	0.4%
55.55555556	817	0.4%
0	688	0.3%
25	431	0.2%
Other values (3)	629	0.3%
(Missing)	149074	65.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	688	0.3%
11.11111111	138	0.1%
22.22222222	227	0.1%
25	431	0.2%
33.33333333	264	0.1%
44.44444444	885	0.4%
50	1711	0.8%
55.55555556	817	0.4%
66.66666667	1877	0.8%
75	9400	4.1%

Value	Count	Frequency (%)
100	50819	22.4%
88.88888889	5367	2.4%
77.77777778	4839	2.1%
75	9400	4.1%
66.66666667	1877	0.8%
55.55555556	817	0.4%
50	1711	0.8%
44.44444444	885	0.4%
33.33333333	264	0.1%
25	431	0.2%

wime_komfort
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	50395
Missing (%)	22.2%
Infinite	0
Infinite (%)	0.0%
Mean	78.91358803

Minimum	0
Maximum	100
Zeros	2918
Zeros (%)	1.3%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	33.33333333
Q1	75
median	77.77777778
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	25

Descriptive statistics

Standard deviation	22.84215857
Coefficient of variation (CV)	0.2894578632
Kurtosis	1.473248838
Mean	78.91358803
Median Absolute Deviation (MAD)	22.22222222
Skewness	-1.241285089
Sum	13899997.22
Variance	521.7642082
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	67219	29.7%
75	36387	16.1%
77.77777778	17438	7.7%
88.88888889	12623	5.6%
66.66666667	10817	4.8%
50	10106	4.5%
55.55555556	5996	2.6%
44.44444444	4845	2.1%
0	2918	1.3%
25	2750	1.2%
Other values (3)	5043	2.2%
(Missing)	50395	22.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2918	1.3%
11.11111111	1002	0.4%
22.22222222	1685	0.7%
25	2750	1.2%
33.33333333	2356	1.0%
44.44444444	4845	2.1%
50	10106	4.5%
55.55555556	5996	2.6%
66.66666667	10817	4.8%
75	36387	16.1%

Value	Count	Frequency (%)
100	67219	29.7%
88.88888889	12623	5.6%
77.77777778	17438	7.7%
75	36387	16.1%
66.66666667	10817	4.8%
55.55555556	5996	2.6%
50	10106	4.5%
44.44444444	4845	2.1%
33.33333333	2356	1.0%
25	2750	1.2%

wime_sauberkeit
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	13
Distinct (%)	< 0.1%
Missing	47232
Missing (%)	20.8%
Infinite	0
Infinite (%)	0.0%
Mean	79.30538902

Minimum	0
Maximum	100
Zeros	1583
Zeros (%)	0.7%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	44.44444444
Q1	75
median	77.77777778
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	25

Descriptive statistics

Standard deviation	21.44728534
Coefficient of variation (CV)	0.2704391922
Kurtosis	1.142929158
Mean	79.30538902
Median Absolute Deviation (MAD)	22.22222222
Skewness	-1.102926376
Sum	14219852.78
Variance	459.9860485
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	66268	29.3%
75	39181	17.3%
77.77777778	18011	8.0%
88.88888889	13642	6.0%
50	12495	5.5%
66.66666667	10775	4.8%
55.55555556	5581	2.5%
44.44444444	4508	2.0%
25	3170	1.4%
33.33333333	2167	1.0%
Other values (3)	3507	1.5%
(Missing)	47232	20.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1583	0.7%
11.11111111	606	0.3%
22.22222222	1318	0.6%
25	3170	1.4%
33.33333333	2167	1.0%
44.44444444	4508	2.0%
50	12495	5.5%
55.55555556	5581	2.5%
66.66666667	10775	4.8%
75	39181	17.3%

Value	Count	Frequency (%)
100	66268	29.3%
88.88888889	13642	6.0%
77.77777778	18011	8.0%
75	39181	17.3%
66.66666667	10775	4.8%
55.55555556	5581	2.5%
50	12495	5.5%
44.44444444	4508	2.0%
33.33333333	2167	1.0%
25	3170	1.4%

wime_puenktlich
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	46621
Missing (%)	20.6%
Infinite	0
Infinite (%)	0.0%
Mean	88.91320579

Minimum	0
Maximum	100
Zeros	4598
Zeros (%)	2.0%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	33.33333333
Q1	88.88888889
median	100
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	11.11111111

Descriptive statistics

Standard deviation	22.12768183
Coefficient of variation (CV)	0.2488683389
Kurtosis	6.159402156
Mean	88.91320579
Median Absolute Deviation (MAD)	0
Skewness	-2.509552242
Sum	15996908.33
Variance	489.6343031
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	124288	54.9%
75	17208	7.6%
88.88888889	11702	5.2%
77.77777778	7321	3.2%
0	4598	2.0%
50	4093	1.8%
66.66666667	2952	1.3%
25	2093	0.9%
44.44444444	1566	0.7%
55.55555556	1485	0.7%
Other values (3)	2610	1.2%
(Missing)	46621	20.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	4598	2.0%
11.11111111	629	0.3%
22.22222222	988	0.4%
25	2093	0.9%
33.33333333	993	0.4%
44.44444444	1566	0.7%
50	4093	1.8%
55.55555556	1485	0.7%
66.66666667	2952	1.3%
75	17208	7.6%

Value	Count	Frequency (%)
100	124288	54.9%
88.88888889	11702	5.2%
77.77777778	7321	3.2%
75	17208	7.6%
66.66666667	2952	1.3%
55.55555556	1485	0.7%
50	4093	1.8%
44.44444444	1566	0.7%
33.33333333	993	0.4%
25	2093	0.9%

wime_platzangebot
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	45836
Missing (%)	20.2%
Infinite	0
Infinite (%)	0.0%
Mean	80.26031646

Minimum	0
Maximum	100
Zeros	6262
Zeros (%)	2.8%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	22.22222222
Q1	75
median	100
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	25

Descriptive statistics

Standard deviation	26.7383851
Coefficient of variation (CV)	0.3331457722
Kurtosis	1.385339091
Mean	80.26031646
Median Absolute Deviation (MAD)	0
Skewness	-1.454391955
Sum	14503119.44
Variance	714.941238
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	91346	40.3%
75	25485	11.2%
77.77777778	12081	5.3%
88.88888889	10341	4.6%
50	9523	4.2%
66.66666667	6876	3.0%
0	6262	2.8%
25	4450	2.0%
55.55555556	4096	1.8%
44.44444444	3937	1.7%
Other values (3)	6304	2.8%
(Missing)	45836	20.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	6262	2.8%
11.11111111	1549	0.7%
22.22222222	2316	1.0%
25	4450	2.0%
33.33333333	2439	1.1%
44.44444444	3937	1.7%
50	9523	4.2%
55.55555556	4096	1.8%
66.66666667	6876	3.0%
75	25485	11.2%

Value	Count	Frequency (%)
100	91346	40.3%
88.88888889	10341	4.6%
77.77777778	12081	5.3%
75	25485	11.2%
66.66666667	6876	3.0%
55.55555556	4096	1.8%
50	9523	4.2%
44.44444444	3937	1.7%
33.33333333	2439	1.1%
25	4450	2.0%

wime_gesamtzuf
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	13
Distinct (%)	< 0.1%
Missing	38474
Missing (%)	17.0%
Infinite	0
Infinite (%)	0.0%
Mean	84.58338725

Minimum	0
Maximum	100
Zeros	2040
Zeros (%)	0.9%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	50
Q1	75
median	88.88888889
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	25

Descriptive statistics

Standard deviation	19.58225893
Coefficient of variation (CV)	0.2315142438
Kurtosis	3.750400158
Mean	84.58338725
Median Absolute Deviation (MAD)	11.11111111
Skewness	-1.725912029
Sum	15907005.56
Variance	383.4648649
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	87829	38.8%
75	37915	16.7%
88.88888889	20359	9.0%
77.77777778	16801	7.4%
50	7048	3.1%
66.66666667	6768	3.0%
55.55555556	2801	1.2%
44.44444444	2196	1.0%
0	2040	0.9%
25	1869	0.8%
Other values (3)	2437	1.1%
(Missing)	38474	17.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2040	0.9%
11.11111111	475	0.2%
22.22222222	915	0.4%
25	1869	0.8%
33.33333333	1047	0.5%
44.44444444	2196	1.0%
50	7048	3.1%
55.55555556	2801	1.2%
66.66666667	6768	3.0%
75	37915	16.7%

Value	Count	Frequency (%)
100	87829	38.8%
88.88888889	20359	9.0%
77.77777778	16801	7.4%
75	37915	16.7%
66.66666667	6768	3.0%
55.55555556	2801	1.2%
50	7048	3.1%
44.44444444	2196	1.0%
33.33333333	1047	0.5%
25	1869	0.8%

wime_preis_leistung
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	15301
Missing (%)	6.8%
Infinite	0
Infinite (%)	0.0%
Mean	73.89085352

Minimum	0
Maximum	100
Zeros	6364
Zeros (%)	2.8%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	25
Q1	50
median	75
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	50

Descriptive statistics

Standard deviation	26.43170844
Coefficient of variation (CV)	0.3577128586
Kurtosis	0.2255697471
Mean	73.89085352
Median Absolute Deviation (MAD)	25
Skewness	-0.9196123172
Sum	15608408.33
Variance	698.6352108
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	75551	33.4%
75	45071	19.9%
50	25270	11.2%
77.77777778	13293	5.9%
66.66666667	10076	4.4%
25	8402	3.7%
88.88888889	7804	3.4%
0	6364	2.8%
55.55555556	6284	2.8%
44.44444444	6253	2.8%
Other values (3)	6868	3.0%
(Missing)	15301	6.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	6364	2.8%
11.11111111	1219	0.5%
22.22222222	2588	1.1%
25	8402	3.7%
33.33333333	3061	1.4%
44.44444444	6253	2.8%
50	25270	11.2%
55.55555556	6284	2.8%
66.66666667	10076	4.4%
75	45071	19.9%

Value	Count	Frequency (%)
100	75551	33.4%
88.88888889	7804	3.4%
77.77777778	13293	5.9%
75	45071	19.9%
66.66666667	10076	4.4%
55.55555556	6284	2.8%
50	25270	11.2%
44.44444444	6253	2.8%
33.33333333	3061	1.4%
25	8402	3.7%

wime_fahrplan
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	8190
Missing (%)	3.6%
Infinite	0
Infinite (%)	0.0%
Mean	83.35784834

Minimum	0
Maximum	100
Zeros	5237
Zeros (%)	2.3%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	25
Q1	75
median	100
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	25

Descriptive statistics

Standard deviation	23.89661238
Coefficient of variation (CV)	0.2866750145
Kurtosis	2.525530506
Mean	83.35784834
Median Absolute Deviation (MAD)	0
Skewness	-1.682809537
Sum	18200936.11
Variance	571.0480832
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	118187	52.2%
75	32842	14.5%
77.77777778	14678	6.5%
88.88888889	12666	5.6%
50	10663	4.7%
66.66666667	7748	3.4%
0	5237	2.3%
25	4365	1.9%
55.55555556	3956	1.7%
44.44444444	3745	1.7%
Other values (3)	4260	1.9%
(Missing)	8190	3.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	5237	2.3%
11.11111111	840	0.4%
22.22222222	1509	0.7%
25	4365	1.9%
33.33333333	1911	0.8%
44.44444444	3745	1.7%
50	10663	4.7%
55.55555556	3956	1.7%
66.66666667	7748	3.4%
75	32842	14.5%

Value	Count	Frequency (%)
100	118187	52.2%
88.88888889	12666	5.6%
77.77777778	14678	6.5%
75	32842	14.5%
66.66666667	7748	3.4%
55.55555556	3956	1.7%
50	10663	4.7%
44.44444444	3745	1.7%
33.33333333	1911	0.8%
25	4365	1.9%

wime_oes_fahrt
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	13
Distinct (%)	< 0.1%
Missing	54445
Missing (%)	24.0%
Infinite	0
Infinite (%)	0.0%
Mean	90.68931476

Minimum	0
Maximum	100
Zeros	405
Zeros (%)	0.2%
Negative	0
Negative (%)	0.0%
Memory size	1.7 MiB

Quantile statistics

Minimum	0
5-th percentile	66.66666667
Q1	77.77777778
median	100
Q3	100
95-th percentile	100
Maximum	100
Range	100
Interquartile range (IQR)	22.22222222

Descriptive statistics

Standard deviation	14.74616729
Coefficient of variation (CV)	0.162600934
Kurtosis	5.606273125
Mean	90.68931476
Median Absolute Deviation (MAD)	0
Skewness	-2.017445543
Sum	15606905.56
Variance	217.4494496
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
100	107734	47.6%
75	23036	10.2%
88.88888889	16983	7.5%
77.77777778	12813	5.7%
66.66666667	4225	1.9%
50	3252	1.4%
55.55555556	1485	0.7%
44.44444444	943	0.4%
25	586	0.3%
0	405	0.2%
Other values (3)	630	0.3%
(Missing)	54445	24.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	405	0.2%
11.11111111	106	< 0.1%
22.22222222	210	0.1%
25	586	0.3%
33.33333333	314	0.1%
44.44444444	943	0.4%
50	3252	1.4%
55.55555556	1485	0.7%
66.66666667	4225	1.9%
75	23036	10.2%

Value	Count	Frequency (%)
100	107734	47.6%
88.88888889	16983	7.5%
77.77777778	12813	5.7%
75	23036	10.2%
66.66666667	4225	1.9%
55.55555556	1485	0.7%
50	3252	1.4%
44.44444444	943	0.4%
33.33333333	314	0.1%
25	586	0.3%

Auto

The auto setting is an easily interpretable pairwise column metric of the following mapping: vartype-vartype : method, categorical-categorical : Cramer's V, numerical-categorical : Cramer's V (using a discretized numerical column), numerical-numerical : Spearman's ρ. This configuration uses the best suitable for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	wime_personal	wime_komfort	wime_sauberkeit	wime_puenktlich	wime_platzangebot	wime_gesamtzuf	wime_preis_leistung	wime_fahrplan	wime_oes_fahrt
0	226335	NaN	25.0	75.0	75.0	100.0	100.0	100.0	100.0	75.0
1	226400	75.0	75.0	50.0	100.0	50.0	75.0	50.0	75.0	100.0
2	226141	NaN	NaN	NaN	NaN	NaN	NaN	100.0	100.0	NaN
3	226748	NaN	25.0	75.0	75.0	75.0	75.0	75.0	75.0	100.0
4	226415	NaN	100.0	50.0	100.0	75.0	100.0	50.0	50.0	50.0
5	226408	75.0	75.0	75.0	100.0	75.0	75.0	25.0	50.0	100.0
6	226754	100.0	75.0	75.0	100.0	75.0	100.0	100.0	100.0	100.0
7	226404	NaN	75.0	75.0	50.0	100.0	100.0	75.0	75.0	75.0
8	226403	100.0	100.0	75.0	NaN	100.0	75.0	100.0	75.0	NaN
9	226760	75.0	100.0	100.0	100.0	100.0	75.0	75.0	75.0	100.0

Last rows

	df_index	wime_personal	wime_komfort	wime_sauberkeit	wime_puenktlich	wime_platzangebot	wime_gesamtzuf	wime_preis_leistung	wime_fahrplan	wime_oes_fahrt
226527	880	100.0	77.777778	55.555556	100.000000	100.000000	77.777778	77.777778	100.000000	100.000000
226528	881	NaN	100.000000	77.777778	100.000000	77.777778	88.888889	33.333333	44.444444	100.000000
226529	882	NaN	77.777778	66.666667	100.000000	66.666667	77.777778	88.888889	77.777778	77.777778
226530	883	100.0	88.888889	77.777778	100.000000	88.888889	88.888889	88.888889	88.888889	88.888889
226531	884	NaN	66.666667	100.000000	100.000000	100.000000	88.888889	66.666667	100.000000	100.000000
226532	885	NaN	100.000000	100.000000	100.000000	100.000000	100.000000	100.000000	100.000000	100.000000
226533	886	100.0	22.222222	55.555556	11.111111	0.000000	33.333333	0.000000	22.222222	44.444444
226534	887	NaN	77.777778	55.555556	100.000000	100.000000	77.777778	0.000000	100.000000	100.000000
226535	888	NaN	66.666667	77.777778	100.000000	66.666667	77.777778	55.555556	55.555556	66.666667
226536	913	NaN	100.000000	100.000000	88.888889	100.000000	88.888889	100.000000	100.000000	100.000000

Overview

Variables

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows